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MULTI-MEDIA COMMUNICATION MANAGEMENT SYSTEM 
WITH ENHANCED VIDEO CONFERENCE SERVICES 
Cross Reference to Related Applications 

The present application is a continuation in part of United States Patent 

5 Application 09/961 ,532 titled Teledata Space and Docking Station with Modular and 

Integrated Display filed on September 24, 2001, and is a continuation in part of 

United States Patent Application 10/000,543 filed on October 23, 2001, titled 

Modular Multi-Media Communication Management System, the contents of both 

such patent applications are incorporated herein. 

10 Technical Field 

The present invention relates generally to managing multi-media 
communications, and more particularly to a modular system for managing video 
conference communications. 

Background of the Invention 

15 Multi party calls or conference calls have provided a convenient method for 

enabling remotely located individuals to orally participate in a meeting. Many 
existing PBX systems enable the operator of a desk top telephone to place calls to 
multiple parties and conference the multiple parties together. The PBX establishes 
a circuit switched connection with each participant (whether on the Public Switched 

20 Telephone Network (PSTN) or the private network controlled by the PBX) and then 
bridges the lines together. 

One problem associated with such a system is that the operator of the desk 
top phone must initiate the conference call by dialing each participant and using an 
appropriate conference button(s) and/or a hold button(s) to bring all participants 

25 together. Such a process is time consuming at best. And, if an operator is not 
familiar with the telephone system, such a process may require reliance on a 
manual to properly activate the correct button sequences to dial each participant to 
initiate the call. 

Another problem associated with such systems is that audio quality 
30 degrades when participants are added. The voice volume of each participant may 
be unequal and background noise from each line is aggregated Into the 
conference. Typically audio quality becomes unacceptable when greater than 
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three participants are connected. More recently conferencing bridge systems have 
been developed to improve conference call quality. Typically each participant dials 
into a conferencing bridge and enters a pass code to join a conference. The 
conferencing bridge includes signal processing circuits for reducing background 
5 noise, echo cancellation, and balancing the volume of different speakers. 

A problem with conferencing bridge systems is that the conference call must 
be scheduled with the bridge and each caller must call into the bridge. Therefore, if 
the operator of a desk to telephone desires to set up a conference call with four 
participants, the operator must first schedule a call with the bridge and set a pass 

10 code for participants to use when calling into the bridge. Secondly, the operator 
must notify each participant of the dial-in number to the bridge and the pass code to 
enter the conference. This is at least as cumbersome as dialing all four participants 
and utilizing the PBX for the conference. 

Another problem associated with both the PBX system and the bridge 

15 system is that there exists no convenient system for monitoring participation in the 
conference call. In the bridge system, a participant could manually track entries 
and departures based on the system notifications, manually tracking entries and 
departures to detemnine who is participating in the call at any given time is subject 
to error, distracting, and cumbersome. 

20 Yet another problem associated with the known conferencing systems is that 

they do not provide a system for two or more remote participants to converse in 
private such that they can hear each other but can not be heard by the other 
participants. 

What is needed is a multi-media communication management system that 
25 provides audio and video conferencing services that does not suffer the 
disadvantages of the existing communication systems. 

Summary of the Invention 
The multi-media communication management system comprises a control 
unit that interfaces with a plurality of communication space stations, and their 
30 associated subscriber device(s), and with one or more communication medium 
service providers. 
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The control unit translates multi-media communications received from a 
multi-media service provider into the protocols required for use by the 
communication space stations as well as any conventional telephone stations that 
may be coupled to the control unit. The communication and control signaling 
5 between the control unit and the communication space stations may be wireless in 
nature with the communication space stations may each be powered by an internal 
battery and/or connection to a local source of conventional line power. 

The architecture of the communication space station is modular. Multiple 
functional elements can be interconnected with backbone communication circuitry 
10 to form an integrated communication platform. Modular docking interfaces may be 
used to couple the space station communication device to portable subscriber 
If devices and to enable integrated and coordinated communication through multiple 
communication medium service providers. This coordinated and integrated system 
^ architecture enables the space station communication device to merge the 

-■^ 15 functionality and internal data of the various portable subscriber devices into the 
space station communication device, to direct the functionality and data of the 
• ; space station communication device to a selected one of the portable subscriber 
devices, and to provide the subscriber with a simple subscriber interface. 

The multi-media communication services provided by the control unit may 
20 include audio/video conference call mixing. The control unit may establish an audio 
or an audio/video communication session with each of a plurality of communication 
space stations and telephones or video telephone systems coupled to the 
communication medium. 

A participant of an audio/video conference session may utilize a 
25 communication space station for controlling the session, establishing and 
terminating side conversations, putting certain participants on hold, and selecting 
amongst multiple video signals for viewing. 

For a better understanding of the present invention, together with other and 
further aspects thereof, reference is made to the following description, taken in 
30 conjunction with the accompanying drawings, and its scope will be pointed out in 
the appended clams. 
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Brief Description of the Drawings 

Figure 1 is a block diagram view of a multi-media communication 
management system in accordance with one embodiment of the present invention; 
Figure 2 is a block diagram of a multi-media communication management 
5 system control unit in accordance with one embodiment of the present invention; 

Figure 3 is a perspective exploded view of a modular communication space 
station in accordance with one embodiment of the present invention; 

Figure 4 is a block diagram of a communication space station in accordance 
with one embodiment of the present invention; 
10 Figure 5 is a block diagram of a subscriber data assistant in accordance with 

one embodiment of the present invention; 

Figure 6 is a block diagram of a wide area network communication device in 
accordance with one embodiment of the present invention; 

Figure 7 is a block diagram of a wireless dialog handset in accordance with 
15 one embodiment of the present invention; 

Figures 8a is a table diagram representing a current network location table in 
accordance with one embodiment of the present invention; 

Figure 8b is a table diagram representing a multicast group table in 
accordance with one embodiment of the present invention; 
20 Figures 9a through 9j each show a flow chart representing processing steps 

performed by a multi-media communication management system in accordance 
with one embodiment of the present invention; 

Figures 10a through 10h each show an exemplary display of information to a 
subscriber utilizing a subscriber interface of a communication space station in 
25 accordance with one embodiment of the present invention; and 

Figures 11a through 11c each show a flow chart representing exemplary 
operation of packet audio/video gateway in accordance with one embodiment of the 
present invention. 

Detailed D escription of the Drawings 

30 The present invention is now described in detail with reference to the 

drawings. In the drawings, each element with a reference number is similar to 
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other elements with the same reference number independent of any letter 
designation following the reference number. 

It should also be appreciated that many of the elements discussed In this 
specification may be implemented in hardware circuit(s), a processor executing 
5 software code, or a combination of a hardware circuit and a processor executing 
code. As such, the term circuit or module as used throughout this specification is 
intended to encompass a hardware circuit (whether discrete elements or an 
integrated circuit block), a processor executing code, or a combination of a 
hardware circuit and a processor executing code, or other combinations of the 

Q 

Q 10 above known to those skilled In the art. 

f3 Referring to Figure 1, an exemplary architecture of the multi-media 

iJI communication management system 10 of the present invention is shown. The 
I J multi-media communication management system 10 includes a control unit 12 that 
„ is coupled with a plurality of local communication devices 20 over a wireless Local 
°: 15 Area Network 22 (or by a wired network connection 23 to the backbone wired 
network of the wireless Local Area Network 22). The local communication devices 
20 may include: subscriber stations 24 (communication space stations 24), wireless 
dialog handsets 26, traditional telephone handsets 28, traditional fax machines 30 
(both coupled through communication space station 24), traditional computer 
20 systems 32, network printers 46, and various network appliances 34. 

The control unit 12 includes a circuit switched provider bay 25 which 
operatlvely couples the control unit 12 to one or more subscriber loops of the Public 
Switched Telephone Network (PSTN) 42 and includes a multi-media 
communication service provider bay 14 which operatively couples the control unit 
25 12 to a multi-media Service Provider network 18 through one of a plurality of 
communication medium modules 16a-16d. In the exemplary embodiment, the 
multi-media Service Provider network 18 may utilize the Internet Protocol Suite for 
communication at the IP level, but may be proprietary at the data link and physical 
layers. As such, the control unit 12 includes the IP stacks applicable for 
30 communication between applications over the multi-media Service Provider 
network 18 and each module 16a-16d Includes the applicable data link and 
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physical layer circuits for communication of tP frames over the physical medium of 
the multi-media Sen/ice Provider network 18a-18d. 

Some illustrative examples of communication modules include: 
communication module 16a which may be a cable modem module for 
5 communicating over coaxial cable 36 with a multi-media communication service 
provider such as a local cable company, communication module 16b which may be 
a wide area network radio for communication over a wireless spectrum channel 38 
with a wide area wireless multi-media communication service provider such as an 
analog or digital cellular/PCS telephone service provider, communication module 

10 16c which may be a customer service unit (CSU) for communication over a T1 line 
40 with a multi-media communication provider such as a local telephone service 
provider, and communication module 16d which may be an optical modem for 
communication over a fiber channel 44 with a fiber optic multi-media 
communication service provider. In operation, the control unit 12 integrates and 

15 manages multi-media communication between two or more local communication 
devices 20 and between each local communication device 20 and a remote 
communication system(s) (not shown) coupled to either the multi-media Service 
Provider network 18 or the Public Switched Telephone Network 42. 

Figure 2 shows a block diagram of an exemplary control unit 12. The control 

20 unit 12 includes applicable modules for managing the Local Area Network 22 as an 
IP network. Such modules may include an applicable combination of hubs, routers, 
and switches 29 for managing communications over the Local Area Network 22 as 
well as an address server 220 (e.g. DHCP server) for assigning local IP addresses 
to each local communication device 20. The control unit 12 may also include a 

25 packet voice/video gateway 232, a voice mail module 236, an e-mail module 228, 
and a web server application 230. The packet voice/video gateway 232 provides a 
subscriber's real time full duplex voice communication and voice/video 
communication services. The services may include routing and maintaining a 
subscriber's outgoing calls and incoming calls. A subscriber's outgoing calls may 

30 comprise voice calls, audio/visual calls, and multi-party conference calls (either 
voice or audio/visual) that are originated by a communication space station 24 that 
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is associated witli the subscriber. The destination(s) may be remote packet 
voice/video devices coupled to the multi-media Service Provider network 18, 
remote telephones coupled to the Public Switched Telephone Network 42, or other 
subscriber's served the multi media communication management system 10. A 
5 subscriber's incoming calls may comprise calls (either voice or audio/visual) that 
are originated by a remote telephone device coupled to the Public Switched 
Telephone Network 42, remote packet audio/visual devices coupled to the multi- 
media Service Provider network 18, communication space stations 24, or the 
audio/visual conference module and identify the subscriber as the destination 
10 subscriber. 

The packet voice/video gateway 232 communicates over the Local Area 
Network 22 and the multi-media Service Provider Network 18 utilizing IP protocols 
as discussed herein. However, voice communication over the Public Switched 
Telephone Network 42 utilized analog or Public Switched Telephone Network 

15 digital voice signals. As such, the control unit 12 includes a Public Switched 
Telephone Network interface 25 that includes circuits for translating between the 
Public Switched Telephone Network call signaling with its analog or digital voice 
communication and the call signaling and digital voice communication formats and 
protocols used by the packet voice/video gateway 232. Therefore, for the sake of 

20 simplicity, he discussion of the packet voice/video gateway 232 herein refers to 
Public Switched Telephone Network interface 25 as an originating or destination 
device with which a voice call may be established and maintained. However, it 
should be appreciated that the Public Switched Telephone Network interface 25 is 
not the ultimate origination or destination but is operating to interface the packet 

25 voice/video gateway 232 to a telephone system on the Public Switched Telephone 
Network 42 with which it could not communication directly. 

The packet voice/video gateway 232 includes a call signaling module 227. 
The call signaling module 227 includes circuits for receiving call signaling 
messages from an originating device, identifying a destination device, providing call 

30 signaling messages to the destination device, and, if responded to by the 
destination device, negotiating compression algorithms and establishing channel 
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usage for the relay of real time voice or audio/visual communications. For inbound 
calls, the call signaling message provided by the originating device may identify a 
subscriber served the multi-media communication management system 10. The 
call signaling module 227 identifies the communication space station 24 that is 
5 presently serving the subscriber device 50 that is assigned to the identified 
subscriber. Referring to Figure 1 1 in conjunction with the network location table 
245 of Figure 8a, the process of identifying a destination device is shown. 

Step 600 represents receipt by the multi-media communication management 
system 10 of the call signaling message identifying the subscriber who is the called 

10 party. In the exemplary embodiment, each subscriber is assigned a four digit 
subscriber identifier number that corresponds to the last four digits of a Public 
Switched Telephone Network direct dial number that routes to the Public Switched 
Telephone Network interface 25 when dialed on the Public Switched Telephone 
Network. As such, the call signaling message, whether provided by an originating 

15 device coupled to multi-media Service Provider network 18, an originating device 
coupled to Local Area Network 22, or the Public Switched Telephone Network 
interface 25, may include the subscriber identifier number to identify the destination 
subscriber. 

At step 602, the call signaling module 227 identifies a subscriber device 50 
20 (Figure 1 ) that is associated with the Identified subscriber by utilizing the network 
location table 245 that is maintained In memory 235. To associate each subscriber 
with their subscriber device 50, the network location table 245 includes a record for 
each subscriber. Within such record is a plurality of data fields that identify: the 
subscriber, the four digit subscriber identifier associated with the subscriber, and a 
25 subscriber device ID code that Is unique to the subscriber device 50 that is 
assigned to the subscriber. 

At step 604, the call signaling module 227 identifies whether the subscriber's 
subscriber device 50 is served by a communication space station 24. The network 
location table 245 further includes a field that may comprise the network address of 
30 the communication space station 24 that is then presently serving the subscriber 
device 50 assigned to the subscriber. The address within this field is updated when 
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the subscriber moves their subscriber device 50 from one communication space 
station 24 to another using the circuits and methods discussed herein. If the 
subscriber device is not presently served by any communication space station 24, 
then this field indicates this state using an indicator such as the term "open". 
5 If at step 604, the call signaling module 227 determines that the subscriber 

device 50 assigned to the subscriber is not presently served by any communication 
space station 24, the voice mail module 236 becomes the default destination 
device to which call signaling is provided at step 612. However, if the subscriber 
device 50 is served by a communication space station 24, such communication 

^3 10 space station 24 becomes the destination device to which call signaling is provided 

rg at step 606. 

*5 Step 608 represents the call signaling module 227 determining whether the 

communication space station 24 is responding to the call signaling. In certain 
events, such as when the subscriber is already engaged in a telephone call or if the 
=j 15 subscriber does not answer the Inbound call, the communication space station 24 
•y does not respond to the call signaling. In which case, the voice mail module 236 
-ij again becomes the default destination device to which call signaling is provided at 
■U step 612. 

If the call signaling is responded to by the communication space station 24, 
20 the call signaling module 227 negotiates compression algorithms and establishes 
communication channels with both the communication space station 24 and with 
the originating device to relay voice or audio/visual real time communications for 
the duration of the call. 

If call signaling is provided to the voice mail module 236 at step 612, the call 
25 signaling module 227 negotiates compression algorithms and establishes 
communication channels only to the originating device to relay real time voice 
communications between the voice mail module 236 and the originating device until 
the originating device is disconnected from the voice mail module 236. 

Returning to Figure 2, for outbound calls, the call signaling module 227 may 
30 be provided with a number that represents the intended destination. The number 
may be a 10 digit number routable on the Public Switched Telephone Network, a 
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number identifying a person or station coupled to the multi-media Service Provider 
network 18, or a subscriber ID representing a subscriber to the multi-media 
communication management system 10. The call signaling module 227 may 
identify the destination device first by determining whether the number represents a 

5 person or destination coupled to the multi-media Service Provider network 18, the 
Public Switched Telephone Network routable telephone number, or a subscriber. 
The call signaling module 227 may refer to a directory within memory 235 that 
maps possible numbers to one of the three networks. It should be appreciated that 
a Public Switched Telephone Network routable telephone number may also 

10 represent a person or station coupled to the multi-media Service Provider network 
18. As such, the directory within memory 235 may include a priority such that the 
call signaling model attempts to establish call signaling utilizing multi-media Service 
Provider network 18 as a first priority and the Public Switched Telephone Network 
42 as a second priority. 

15 If the destination device is coupled to the multi-media Service Provider 

network 18, the number may be permanently assigned to a person or a station, 
however, the IP network address utilized by the person or station may change 
periodically. As such, the call signaling module 227 may query a remote directory 
server to determine the network address of the destination device or the network 

20 address of a proxy for the remote device. Call signaling is then provided to the 
destination device or the proxy. If the call signaling is responded to by the proxy or 
the remote device, the call signaling module 227 negotiates compression 
algorithms and establishes communication channels with both the originating 
communication space station 24 and with proxy or remote device for the relay of 

25 voice or audio/visual real time communications for the duration of the call. 

If the destination device is coupled to the Public Switched Telephone 
Network 42, the destination device is the Public Switched Telephone Network 
interface 25 and call signaling is provided to the Public Switched Telephone 
Network interface 25. Again, if the call signaling is responded to by the Public 

30 Switched Telephone Network interface 25 (indicating that the call has been 
established on the Public Switched Telephone Network 42) the call signaling 
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module 227 negotiates compression algorithms and establishes communication 
channels with the originating communication space station 24 for the relay of real 
time voice communications between the communication space station 24 and the 
Public Switched Telephone Network interface 25 for the duration of the call. If the 
5 destination device is a subscriber to the multi-media communication management 
system 10, steps discussed above with respect to Figure 1 1 are applicable. 

For both inbound and outbound calls, the relay of real time voice or 
audio/visual communications is provided by a relay module 229 within the packet 
audio/video gateway 232. The relay module 229 relays sequences of real time 

10 transport protocol (RTP) frames that include compressed voice data and 
compressed video communications over the channels established by the call 
signaling module 227. The relay module 229 also relays real time voice/video 
communications for conference calls between each of the call participants and a 
conference mix module 237. The conference mix module 237 includes audio 

15 mixing circuits for receiving multiple voice streams to generate one or more 
conference mix signals. The conference mix module 237 provides the conference 
mix signals back to the relay module 229 for relay back to the conference session 
participants. 

The voice mail module 226 includes circuits for respond to the call signaling 
20 provided by the call signaling module 227, providing a sequence of RTP frames 
representing applicable audio prompts from compressed audio prompt files 233 to 
the relay module 229, receiving RTP frames from the relay module 229 
representing the voice of the remote caller leaving a message for the subscriber, 
compressing the message into a digital audio file, and sending the digital audio file 
25 to the e-mail module 228 for later retrieval by the subscriber. 

The e-mail module 228 maintains an e-mail account associated with each 
subscriber. The e-mail module 228 includes client circuits for interfacing with a 
remote e-mail server to log onto an account associated with each subscriber, obtain 
new e-mail messages associated with the subscriber, and to send e-mail messages 
30 drafted by the subscriber. The e-mail module 228 also maintains e-mail files 247 in 
the memory 235 that may include an address book 249 and an inbox 246 for each 
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subscriber. 

The web server application 230 provides additional multi-media 
communication services provided to each subscriber. Examples of the multi-media 
communication services provided to each subscriber by the web server application 
5 230 include: delivery of e-mail and voice mail messages (as e-mailed audio files) to 
the communication space station 24 at which the subscriber's subscriber device 50 
Is then presently coupled; updating of the network location table 245 to assure 
proper routing of incoming voice and audio/video calls; proxy communication over 
multi-media Service Provider network 18; and delivery of a multicast messages 

10 directed to a subscriber to the particular communication space station 24 at which 
their subscriber device is then presently coupled. 

The web server application 230 includes a multicast module 231 and an 
address translation module 31. The multicast module 231 provides IP multicast 
services to enable the web server application 230 to deliver select communications 

15 to multiple communication space stations 24 simultaneously utilizing IP multicast 
protocols and without using excessive bandwidth on Local Area Network 22. The 
address translation module 31 provides address and port translation services to 
enable the web server to provide each communication space station 24 with access 
to servers coupled to the multi-media Service Provider network 18 as an IP layer 

20 proxy and without using higher layer resources of the control unit 1 2. 

In the exemplary embodiment, non-streaming media communication 
between the web server application 230 and each communication space station 24 
utilizes tagged data messages over a TCP/IP session between the web sen/er 
application 230 and a system client application 115 (Figure 4) within the 

25 communication space station 24. Each message transferred between the web 
server application 230 and the communication space station 24 comprises a data 
element and a tag identifying the significance of the data element. For example: If 
the data element comprises the text of an e-mail message, the tag would identify 
the data element as the text of an e-mail message; if the data element comprises 

30 an executable script that would provide for the communication space station 24 to 
perfomi a certain function, the tag would Identify the data element as executable 
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script and may identify the significance of the script; and if the data element 
comprises display layout control information (e.g. a style sheet) defining how 
another date element (such as the text of the e-mail) should be displayed on a 
display screen, the tag would identify the data element as a style sheet. Streaming 
5 media communications between the web server application 230 (such as multicast 
streaming media messages provided by the IP multicast module 231) and the 
system client application 115 utilize a sequence of RTP frames that include 
compressed media data and are sent utilizing UDP/IP channels. 

To provide communication services to each subscriber, the web server 

10 application 230 processes certain scripts in response to events generated by a 
communication space station 24 and the packet audio/video gateway 232. In 
processing the scripts, the web server application 230 manages subscriber 
communication data stored in a memory 235 and provides operating instnjctions to 
communication space station client 24 and an e-mail module 228. 

15 The flow charts of Figures 9a through 9g (which are discussed in more detail 

herein) represent processing scripts that in aggregate provide for a subscriber to 
navigate through a layered menu to select applicable services from the control unit 
12. The web server application 230 maintains state Information for each 
communication space station 24 such that each communication space station 24 

20 may navigate through the layered menu independently of other communication 
space station 24 units. 
Communication Space Station 

Referring to Figure 3, a perspective view of an exemplary communication 
space station 24 is shown. The communication space station 24 includes a 

25 platform unit 52 that operatively couples to the control unit 12 via either a wireless 
communication link between a platform unit network circuit 96 and the wireless 
Local Area Network 22 or a direct network connection 23 between the platform unit 
52 and the backbone network of the wireless Local Area Network 22. 

A plurality of functional modules 54, 56, 58, 60, and 11 may be coupled to 

30 the platfomn unit 52 to form an integrated multi-media communication platform. The 
platform unit 52 includes a subscriber Interface docking platform 64 for coupling 
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and optionally supporting one of a plurality of modular subscriber interface units 60 
to the platform unit 52. The modular subscriber interface unit 60a may include a 
plurality of buttons 68 in an arrangement similar to a typical telephone key pad to 
provide for subscriber input in a manner similar to that of a traditional telephone 
5 handset. The modular subscriber interface 60b may include a touch panel graphic 
display 72 to provide for subscriber input through virtual buttons visible thereon. 

The platform unit 52 further includes a first function specific docking platform 
74a and a second function specific docking platform 74b, each of which couples to 
a plurality of function specific modules 54 and 56. The first function specific 

10 docking platform 74a is a shallow platform for coupling to function specific modules 
that primarily comprise function specific buttons or other circuits that may be placed 
within a thin module. The second function specific docking platform 74b is a larger 
platform for coupling to function specific modules with more complex internal 
circuits requiring the additional size. 

15 In the exemplary embodiment, the function specific module 54 may include 

subscriber interface buttons configured for enhancing voice communication through 
the communication space station 24 such as a voice message control 76 for single 
button access to voice message files and voice management controls 85 for single 
button control of enhanced voice management functions. 

20 The function specific module 56 may include circuits configured for 

enhancing data communication through the communication space station 24 such 
as an e-mail control 78 for single button access to subscriber e-mail messages, a 
print control 80 for single button initiation of the printing of an e-mail message, and 
a data networking port 84. 

25 The platform unit 52 further includes a docking bay 62 into which a modular 

docking interface 58 may be secured and operatively coupled to the platform unit 
52. The modular docking interface 58 supports one of a plurality of modular 
subscriber devices 50 within a subscriber device interface bay 66 and provides for 
operatively coupling the modular subscriber device 50 to the platform unit 52. 

30 Exemplary configurations for the modular subscriber device 50 include a subscriber 
data assistant 86, a subscriber wide area network communication device 88, and 
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the wireless LAN voice liandset 26, each of which is discussed in more detail 
herein. 

While operatively coupled to the platform unit 52, the subscriber device 50 
becomes an integral part of the subscriber interface of the communication space 
5 station 24. A liquid crystal graphic display 90 on the subscriber device 50 may 
function to display multi-media communication management information under 
control of the platform unit 52 and the control unit 12. Further, programmable 
subscriber controls 92 positioned adjacent to the subscriber device 50 may be 
configured to activate platform unit 52 and control unit 12 functions in accordance 

10 with the contents of the graphic display 90 adjacent to the controls 92. 

The platform unit 52 also includes docking bay 61 into which a modular 
video camera 11 may be coupled to the communication space station 24. The 
module video camera 11 provides a video image for use by the communication 
space station 24 when participating in a video conference call. 

15 The platform unit 52 may further include one or more of the following 

elements: a handset 98 similar to a traditional telephone handset to provide a 
subscriber voice interface, a speaker 100 and a microphone 102 to provide a 
hands-free subscriber voice interface, a modular battery pack 70 (which fits within a 
battery pack bay that is not shown) for operating power when the communication 

20 space station 24 is uncoupled from a line voltage, cell button 104 for single button 
selection of certain functions such as a wide area network communication function, 
and help button 106 for single button selection of a help function. 

Figure 4 shows a block diagram of the communication space station 24. The 
platform unit 52 includes an application controller 112 coupled to a local bus 116 

25 that interconnects application controller 112 with a plurality of peripheral circuits 
that include a wireless module 94, a power management controller 120, a 
communication controller 122, a network switch controller 124, a key switch 
controller 126, a touch panel controller 128, a plain old telephone service (POTS) 
converter 146, and a voice communication system 130. 

30 The wireless module 94 operatively couples the platform unit 52 with the 

control unit 12 over the wireless Local Area Network 22 (both of Figure 1). The 

Doc. 4729 

- 15 - 



13944.111 



Tel-011 



application controller 112 Includes appropriate drivers for operation of the wireless 
module 94. 

The power management controller 120 selectively receives input power from 
the battery pack 70 or external line voltage 134. The power management controller 
5 120 includes appropriate circuits for converting the input power voltage to 
appropriate operating power required by each component of the communication 
space station 24. Additionally, the power management controller 120 includes 
appropriate circuits for managing charging of the battery pack 70 when the platform 
unit 52 is coupled to the line voltage 134 and generating appropriate power for 
10 operating and/or charging the modular docking Interface 58 and the modular 
subscriber device 50 when coupled to the platform unit 52. 

The communication controller 122 operatively couples the modular docking 
interface 58 and the modular subscriber device 50 to the controller 112 such that 
the platform 52 can exchange data with the modular subscriber device 50. In the 
15 exemplary embodiment the communication controller is a serial communication 
controller that enables the serial exchange of data with a compatible serial 
communication controller within the modular subscriber device 50 over a physical 
medium. Exemplary physical mediums include hardwired contacts, an infrared 
transmission, and RF transmission, however other physical mediums are 
20 envisioned and the selection of a physical medium is not critical to this Invention. 

The communication control 122 also operatively couples the modular video 
camera 11 to the controller 112 such that the platform unit 52 may power the video 
camera 1 1 and receive the video image from the video camera 1 1 . 

The network switch controller 124 provides a network data port 84 which 
25 enables the application controller 112 to communicate with another network 
computing circuit over a network interface. The network switch controller 124 is 
coupled to a bus port 135 within the function specific docking platform 74b for 
coupling to a mating port 148 on the function specific module 56. 

The key switch (e.g. button) controller 126 is coupled to: a connector 136a 
30 which in turn is coupled to a mating connector on the modular subscriber interface 
unit 60a (Figure 3) for interconnecting the buttons 68 to the key switch controller 
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126; a connector 136b which in turn is coupled to a mating connector 142 on the 
function specific module 54 for interconnecting the buttons 76 and 85 to the key 
switch controller 126; the bus port 134 which in turn is coupled to a mating port 148 
on the function specific module 56 for interconnecting the buttons 78 and 80 to the 
5 key switch controller 126; the ceil button 104; and the help button 106. In the 
exemplary embodiment, the key switch controller 126 may drive row and column 
signals to the various buttons and, upon detecting a short between a row and a 
column (e.g. button activation) reports the button activation to the application 
controller 112 over the bus 116. Again, the application controller 112 includes 

10 appropriate drivers for operating the key switch controller 126. 

The touch panel controller 128 is coupled to a connector 144 which in turn is 
coupled to a mating connector on the modular subscriber interface unit 60b (Figure 
3) for Interconnecting the touch panel graphic display 72 to the touch panel 
controller 128. In the exemplary embodiment, the touch panel controller 128 may 

15 include a separate display control circuit compatible with the resolution and color 
depth of the touch panel graphic display 72 and a separate touch panel control 
circuit for detecting subscriber contact with the touch panel graphic display 72. The 
application controller 112 includes appropriate systems for driving the contents of 
the touch panel graphic display 72 through the touch panel controller 128. 

20 The voice communication system 130 generates analog voice signals for 

driving the speaker 100 (or the speaker in the handset 98 of Figure 3) and detects 
input from the microphone 102 (or the microphone in the handset 98) under the 
control the application controller 112. 

The POTS converter circuit 146 provides a standard POTS port signal (e.g. 

25 tip and ring) for operation of a traditional telephone or a traditional fax machine 
coupled to a POTS port 82 on the function specific module 56. In operation the 
POTS converter 146 circuit interfaces between the POTS signal and the application 
controller 112. 

In the exemplary embodiment, the application controller 112 executes a 
30 packet voice/video communication client 113 and a client application 115. The 
packet voice/video communication client 113 provides for setting up and 
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maintaining pacl<et voice connmunications witli the packet voice/video gateway 232 
(Figure 2) witliin the control unit 12. In the exemplary embodiment, the packet 
voice/video communication client 113 may be one of the commercially available 
clients utilizing established protocols. 

5 The system client application 115 operates as a client to the web server 

application 230 (Figure 3) within the control unit 12. The system client application 
115 provides for the application controller 112 to: generate an image on the touch 
panel graphic display 72 or on the graphic display 90 on the subscriber device 50 in 
accordance with display content and a style sheet received from the control unit 12; 

10 output an audio stream file received from the control unit 12 through the voice 
system 130; execute processing steps in accordance with instructions received 
from the control unit 12; provide messages indicating subscriber actions (such as 
subscriber activation of the cell button 104, the help button 106, a touch panel 
virtual button, or any other button on the communication space station 24) to the 

15 web server application 230; activate the packet voice/video client 113 to set up a 
real time voice/video session with the packet voice/video gateway 232 (Figure 2); 
identify the modular configuration or subscriber interface configuration of the 
communication space station 24 and report the configuration to the control unit 12; 
and report the coupling of (and decoupling of) a subscriber device 50 and/or 

20 modules to the platform 52 of the communication space station 24 to the control 
unit 12. 

Subscriber Data Assistant 

Turning to Figure 5, an exemplary structure of a subscriber data assistant 86 
is shown. The subscriber data assistant 86 includes a subscriber data assistant 

25 controller 160 interconnected to a plurality of peripheral controllers by an internal 
bus 162. Because of the small size and the portability of the subscriber data 
assistant 86, the touch panel 90 provides the primary subscriber interface. The 
touch panel 90 is controlled by a display controller 164 and a touch panel controller 
166. The display controller 164 drives the liquid crystal display of touch panel 90 

30 using signals compatible with the resolution and color depth of the display portion 
of the touch panel 90. The touch panel controller 166 detects user activation of the 
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touch panel 90. The subscriber data assistant controller 160 operates appropriate 
drivers 176 for controlling operation of the touch panel controller 166 and the 
display controller 164. 

A communication controller 168 is also coupled to the bus 162 and operates 

5 under control of the subscriber data assistant controller 160. In the exemplary 
embodiment, the communication controller 168 is a serial communication controller 
that is compatible with the communication controller 122 of the platform unit 52 
(both of Figure 4) such that data communication may occur between the platform 
unit 52 and the subscriber data assistant 86 when the subscriber data assistant 86 

10 is operatively coupled to the platform unit 52. 

A power management circuit 170 selectively receives input power from a 
battery pack 172 or from the power management circuit 120 in the platform unit 52. 
The power management circuit 170 includes appropriate circuits for converting the 
input power voltage to appropriate operating power required by each component of 

15 the subscriber data assistant 86. Additionally, the power management circuit 170 
includes appropriate circuits for managing charging of the battery pack 172 when 
the subscriber data assistant is coupled to the platform unit 52. 

The subscriber data assistant controller 160 also operates a communication 
space station client application 174 for displaying multi-media communication 

20 management information under control the platform unit 52 when coupled to the 
platform unit 52. In the exemplary embodiment the communication space station 
client application 174 receives messages from the platform unit 52 in the form of 
tagged messages. After receipt of the tagged messages, the communication space 
station client application 174 builds a display document to display the 

25 communication management information represented by tagged content messages 
in accordance with a style sheet that is compatible with the size, resolution, and 
color depth of the display portion of touch panel 90. The display document is then 
displayed on the touch panel 90. 

It should be appreciated that in additional to operating the drivers 176 and 

30 the communication space station client application 174, the subscriber data 
assistant controller 160 may optionally operate any of the software applications that 
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are commercially available for portable data assistants (PDAs) which may include 
address book management software, calendar management software, and games. 
While operation of such PDA applications may be useful to the subscriber, it is not 
critical to the operation of the present invention. 

5 Subscriber Wide Area Network Communication Device 

Turning to Figure 6, exemplary structure of a subscriber wide area network 
communication device 88 is shown. The wide area network communication device 
88 includes a subscriber wide area network communication device controller 180 
operating a Communication Space Station application 174', the subscriber contact 

10 directory application 178, a wireless communication application 194, and applicable 
drivers 196 for a plurality of peripheral controllers. The subscriber wide area 
network communication device controller 180 is interconnected to the plurality of 
peripheral controllers by an internal bus 186. The peripheral controllers include a 
wide area networi< RF circuit 182, a voice system 197, a display controller 184, a 

15 touch panel controller 185, a key switch controller 193, a communication controller 
188, and a power management system 190. 

The wide area network RF circuit 182 may be a circuit for transmitting and 
receiving signals from a wide area network service provider's medium under control 
of the wireless communication application 194. Exemplary wide area network 

20 service provider mediums include an analog or digital cellular or PCS telephone RF 
system. The key switch controller 193 Is coupled to the control buttons 195. The 
key switch controller 193 drives row and column signals to the control buttons 195 
and, upon detecting a short: between a row and a column indicating button 
activation, reports the activation to the subscriber wide area network 

25 communication device controller 180. The control buttons 85 may be used by a 
subscriber for operating the wide area network communication device 88 when 
uncoupled form the platform unit 52. 

The voice system 197 includes a speaker and a microphone. Under control 
of the wireless communication application 194, the voice system 197 may provide a 

30 subscriber voice interface for an audio session with a remote device over the wide 
area network service provider's medium. The display controller 184 drives the 

Doc 4729 

-20- 



13944.111 Tel-011 

display 90 using signals compatible with the resolution and color depth of the 
display portion of touch panel 90. The display 90 may optionally be a touch panel 
90 and the touch panel controller 185 detects user activation of the touch panel 90. 
The communication controller 188 may be a serial communication controller 
5 compatible with the communication controller 122 in the platform unit 52 such that 
data communication may occur between the platform unit 52 and the wide area 
network communication device 88 when the wide area network communication 
device is operatively coupled to the platform unit 52. The power management 
controller 190 operating with a battery pack 192, both of which may operate in a 

10 similar manner to the power management controller 170, and the battery pack 172 
discussed with reference to Figure 5. 

Similar to the subscriber data assistant 86 (Figure 5), when the wide area 
network communication device 88 is coupled to the platfomn unit 52, the 
Communication Space Station application 174' provides for displaying multi-media 

15 communication management information under control the platform unit 52 and 
provides for multi-media communication directly between the platfomn unit and the 
wide area network service provider medium. 

In addition the Communication Space Station application 174' may receive 
messages from the platform unit 52 which may be multi-media communication 

20 messages for communication over the wide area network service provider medium. 
Each message includes a tag that identifies the contents of the message. After 
receipt of a tagged message, the Communication Space Station application 174' 
may identify whether the message is for communication with the wide area network 
service provider medium or whether it is multi-media communication management 

25 information for display. When the message is for communication with the wide area 
network service provider medium, the Communication Space Station application 
174' reformats the message to a format compatible with wide area network service 
provider medium transmission standards and transmits the message using the wide 
area network RF circuit 182. The wide area network communication device 88 may 

30 also receive signals from the wide area network service provider medium via the 
wide area network RF circuit 182. When received, the Communication Space 
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Station application 174' reformats the messages Into a plurality of tagged 
messages for communication to the platform unit 52 and sends the tagged 
messages to the platfomn unit 52 via the communication controller 188. 
Wireless Voice Handsets 

Figure 7 shows a block diagram of an exemplary wireless voice handset 26. 
The wireless voice handset 26 includes a network circuit 278 and a wireless voice 
handset controller 250 that operates a Communication Space Station application 
174", the subscriber contact directory application 178, a LAN communication 
application 252, and applicable drivers 254 for each of a plurality of peripheral 
controllers. The wireless voice handset controller 250 is interconnected by a bus 
276 to the plurality of peripheral controllers which include a module controller 258, 
a display driver 260, a touch panel driver 261, a key switch controller 264, and a 
power management circuit 270. 

The module controller 258 operatively couples the network circuit 278 to the 
•Jl 15 wireless voice handset controller 250 such that the wireless voice handset 26 may 
; communicate with the control unit 12 over the wireless Local Area Network 22 (both 
:j of Figure 1). In the exemplary embodiment, the module controller 258 may be a 
;l| PCMCIA controller circuit and the network circuit 278 is configured as a PCMCIA 
card that coupled to the module controller 258 through a PCMCIA connector 272. 
20 The LAN communication application 252 operates the network circuit 278 for 
communicating with the control unit 12 using appropriate wireless signaling 
protocols. 

The key switch controller 264 is coupled to the control buttons 266. The key 
switch controller 264 drives row and column signals to the control buttons 266 and, 

25 upon detecting a short between a row and a column indicating button activation, 
reports the activation to the wireless voice handset controller 250. The control 
buttons may be used by a subscriber for operating the wireless voice handset 26 
when uncoupled form the platform unit 52. The display controller 260 drives the 
display 90 (optionally a touch panel 90) using signals compatible with the resolution 

30 and color depth of the display 90. The touch panel controller 261 detects user 
activation of the touch panel 90. The power management controller 270 operates 
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in conjunction with a battery pack 268, both of which may operate in a similar 
manner to the power management controller 170, and the battery pack 172 
discussed with reference to Figure 5. 

When the wireless voice handset 26 is coupled to the platform unit 52, the 
5 Communication Space Station application 174" provides for displaying multi-media 
communication management information under control the platform unit 52. 
Additionally, the Communication Space Station application 174" may receive multi- 
media communication management infomnation content messages and control 
messages directly from the control unit 12 via the wireless network 22. After receipt 

10 of the tagged messages from either the platform unit 52 or the control unit 12, the 
Communication Space Station application 174" builds a document to display the 
communication management information represented by the tagged content 
messages in accordance with display layout control messages that are compatible 
with the size, resolution, and color depth of the display portion of the touch panel 

15 90. The display document is then displayed on the touch panel 90. 
Web Server Application 

Referring to Figures 9a through 9j in conjunction with Figure 2, exemplary 
processing steps performed by the web server application 230 to provide 
communication services to a communication space station 24 are shown. 

20 The flowchart of Figure 9a represents steps performed by the web server 

application 230 upon receiving an open session request on a predetermined port 
from a communication space station 24 that has just been operatively coupled to 
the Local Area network 22, obtained a network address from the network address 
server 220, and is ready to operate as a client to the web server application 230. 

25 Step 300 represents receipt of the open session request and step 302 represents 
establishing a TCP/IP session with the communication space station 24. 

Step 304 represents sending a start up script to the communication space 
station 24. The start up script includes instructions that, when executed by the 
system client application 115, provide for the communication space station 24 to 

30 detect its subscriber interface configuration (e.g. whether the communication space 
station 24 Includes a display screen and what capabilities such as video capabilities 
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and graphic resolution capabilities tlie display screen may have) and to report its 
subscriber interface configuration back to the web sen/er application 230. 

Step 306 represents receipt of the subscriber interface configuration of the 
communication space station 24 from the communication space station 24 and step 
5 308 represents writing an indication of the subscriber interface configuration of the 
communication space station 24 to a subscriber interface table 239 in the memory 
235. 

Step 310 represents retrieving a main menu display style sheet from a 
selection of style sheets 241 stored in the memory 235. The retrieved main menu 

10 display style sheet will be a style sheet that con-esponds to the subscriber interface 
configuration of the communication space station 24. Step 312 represents 
providing main menu display content and the style sheet to the communication 
space station 24 and step 314 represents updating a communication space station 
state table 243 in the memory 235 to indicate that the communication space station 

15 24 is in a main menu state. 

It should be appreciated that the main menu content provided to the 
communication space station 24 Is independent of the subscriber interface. 
However, the style sheet provided to the communication space station 24 is 
dependent on the subscriber interface. For example, turning to Figure 10a which 

20 represents display of a main menu on a subscriber device 50 in the modular 
docking interface 58 the content of the main menu display includes a title of main 
menu and choices of view e-mail, voice mail, and multi-cast paging. The style 
sheet corresponding to a subscriber interface that includes a subscriber device 50 
provides for the content to be graphically displayed with the title at the top and each 

25 menu choice to be displayed adjacent a button 92 on the modular docking interface 
58. Alternatively, turning to Figure 10b which represents display of a main menu on 
a display 72 that is coupled to a communication space station interface 64 (Figure 
3), the content of the main menu display again includes a title of main menu and 
the choices of view e-mail, voice mail, and multi-cast paging. However, the style 

30 sheet that corresponds to a subscriber interface that includes a display 72 that is 
coupled to a communication space station interface 64 provides for the content to 
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be graphically displayed with the title at the top and each choice to be displayed in 
a vertical list with an adjacent numeral for selection using the keypad 68 (Figure 3). 
The examples shown In Figures 10a and 10b are for illustrative purposes only. 
Other subscriber interface configurations that include non-graphic displays, bit 
5 mapped multi line text displays, or 7 element single or multi line text displays may 
utilized different style sheets for displaying all or a portion of the main menu 
content. 

The flowchart of Figure 9b represents steps performed by the web server 
application 230 upon receiving an indication that a subscriber device 50 has been 

10 coupled to a communication space station 24. Step 316 represents receipt of such 
indication. Step 318 represents sending a device ID extraction script to the 
communication space station 24. The device ID extraction script includes 
' instructions that, when executed by the client application 115, provide for the 
communication space station 24 to interrogate the subscriber device 50 to 

15 determine its device identification (e.g. an identification of which subscriber to which 
the device has been assigned) and to report the device identification back to the 
web server application 230. 

Step 320 represent receipt of the device identification back from the 
communication space station 24 and step 322 represents associating the device ID 

20 with the communication space station 24 in the network location table 245 in the 
memory 235. As discussed previously, the packet voice/video gateway 232 utilizes 
the network location table 245 for routing incoming telephone calls to the particular 
communication space station 24 at which a subscriber's subscriber device 50 is 
then presently coupled. It should be appreciated that this step 322 provides for the 

25 network location table 245 to properly indicate association between a 
communication space station 24 and the subscriber device 50 that is served 
thereby. 

Because the style sheet selected for display of content on the 
communication space station 24 is dependent on the subscriber interface 
30 configuration of the communication space station 24 as determined by the 
subscriber interface table 239, the table should be updated when the subscriber 
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interface configuration clianges. Coupling a subscriber device 50 to a 
communication space station 24 clianges the subscriber interface because tlie 
display of the subscriber device 50 becomes a display for the communication space 
station 24. As such, step 324 represents updating the subscriber interface 
5 configuration of the communication space station 24 in the subscriber interface 
table 239. 

Step 326 represents retrieving a main menu display style sheet that is 
applicable to the new subscriber interface configuration from the selection of style 
sheets 241 in the memory 235 and step 328 represents providing main menu 
10 display contend and the style sheet to the communication space station 24. Step 
330 represents updating the communication space station state table 243 to assure 
that it represents that the communication space station 24 is in the main menu 
state. 

The flow chart of Figure 9c represents steps performed by the web server 

15 application 230 upon receiving an indication that a subscriber device 50 has been 
removed from a communication space station 24. Step 322 represents receipt of 
such an indication. Because the packet audio/video gateway 232 utilizes the 
network location table 245 for routing incoming telephone calls to the particular 
communication space station 24 at which a subscriber's subscriber device 50 is 

20 then presently coupled. The network location table should be updated upon 
removal of a subscriber device form a communication space station 24. Step 334 
represents disassociating the subscriber device 50 from the communication space 
station 24 in the network location table 245. Because the display on the subscriber 
device 50 is no longer part of the subscriber interface of the communication space 

25 station 24 after the subscriber device 50 is removed, step 336 represents updating 
the subscriber interface configuration table 239. 

Step 338 represents retrieving a main menu display style sheet that is 
applicable to the subscriber interface configuration without the subscriber device 50 
from the selection of style sheets 241 in the memory 235 and step 340 represents 

30 providing main menu display content and the style sheet to the communication 
space station 24. Step 342 represents updating the communication space station 
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state table 243 to assure that it represents that the communication space station 24 
is in the main menu state. 

The flowchart of Figure 9cl represents steps performed by the web server 
application 230 upon receiving a subscriber indication of a command to view 

5 subscriber e-mail messages. The means by which the communication space 
station 24 may detect such a subscriber indication is dependent on the subscriber 
interface configuration of the communication space station 24. For example, if the 
subscriber interface includes the e-mail button 78 (Figure 3), detection of button 78 
activation would be a subscriber Indication of a command to view subscriber e-mail 

10 messages. Similarly, subscriber activation of the e-mai! menu choice on the main 
menu either by touch panel activation or by activation of a button associated with 
the menu choice (either or both of which may be applicable dependent on the 
subscriber interface configuration) would be a subscriber indication of a command 
to view subscriber e-mai! messages. Step 344 represents the web server 

15 application 230 receiving the subscriber indication of a command view subscriber e- 
mail messages. 

Step 346 represents instructing the e-mail module 228 to logon onto an e- 
mail server (which may be a remote e-mail server coupled to the Service Provider 
network 18) and to receive new e-mail messages associated with the subscriber's 

20 account. Step 348 represents writing the new e-mail messages to the subscriber 
Inbox in the e-mail files 247 in the memory 235. In an embodiment wherein the 
remote e-mail server maintains subscriber Inbox information, steps 346 and 348 
may be viewed as synchronizing the e-mail messages between the remote server 
and the e-mail files 247. It should also be appreciated that the e-mail module 228 

25 may periodically retrieve new e-mail messages and write to the subscriber inbox 
independently of whether the subscriber has activated an e-mail control. As such, 
the inbox already includes new messages and steps 348 and 348 may not need to 
be performed in response to event 344. 

Step 350 represents retrieving inbox content from the e-mail files 247 and 

30 step 352 represents retrieving an inbox style sheet that is applicable to the 
subscriber interface from the style sheets 241 in the memory 235. Because the 
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subscriber's voice mails are sent to the subscriber's e-mail account as audio files, it 
is possible that the e-mail messages retrieved at step 346 include both text based 
e-mails and e-mails from the voice mail server 226. Because the subscriber 
activated a command to view e-mail messages, the inbox style sheet provides for 

5 the display of the e-mail messages received from senders other than the voice mail 
server 226 to be displayed first (or on the top of the display). 

Step 354 represents providing the inbox content and style sheet to the 
communication space station 24 and step 356 represents updating the 
communication space station state table 243 to indicate that the communication 

10 space station 24 is in an e-mail state. 

The flowchart of Figure 9e represents steps performed by the web server 
application 230 receiving a subscriber indication of a command to obtain voice mail 
messages. Again, the means by which the communication space station 24 may 
detect such a subscriber indication is dependent on the subscriber interface 

15 configuration of the communication space station 24. For example, if the 
subscriber interface includes the voice mail button 76 (Figure 3). detection of button 
76 activation is a subscriber indication of a command to obtain voice mail 
messages. Similarly, subscriber activation of the voice mail menu choice either by 
touch panel activation or by activation of a button associated with the menu choice 

20 is a subscriber Indication of a command to obtain voice mall messages. Step 358 
represents the web server application 230 receiving the subscriber indication of a 
command obtain voice mail messages. 

Because voice mail messages are sent as audio files form the voice mail 
server 226 to the subscriber's e-mail account, step 360 represents instructing the e- 

25 mall module 228 to logon onto the e-mail server and to receive new e-mail 
messages associated with the subscribers account. Step 362 represents writing 
the new e-mail messages to the subscriber Inbox in the e-mail files 247 in the 
memory 235. 

Step 364 represents retrieving inbox content from the e-mail files 247 and 
30 step 366 represents retrieving an voice mail style sheet that is applicable to the 
subscriber interface from the style sheets 241 in the memory 235. Because the e- 
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mail messages that include voice mail audio files from the voice mail server 226 
may be intermixed with e-mail messages from other senders, the voice mail style 
sheet provides for only the display of the voice mail messages received from the 
voice mail server 226. 

5 Step 368 represents providing the inbox content and the voice mail style 

sheet to the communication space station 24 and step 370 represents updating the 
communication space station state table 243 to indicate that the communication 
space station 24 is in a voice mail state. 

The flowchart of Figure 9f represents steps performed by the web server 

10 application 230 upon receiving a subscriber indication of a command to initiate a 
multicast paging message. The communication space station 24 may detect such 
a subscriber indication by various means, such as touch panel activation of button 
activation of a menu selection on the main menu, dependent on the subscriber 
interface configuration of the communication space station 24. Step 372 

15 represents the web server application 230 receiving the subscriber indication of a 
command to initiate a multicast paging message. 

Step 374 represents retrieving the subscriber's address book content 249 
from the e-mail files 247. Turning briefly to Figure 8b, the address book content 
249 may comprise a plurality of records with each record including a group 

20 identification name and identification of each subscriber in such group, and, if the 
group identifies a single person, contact infomnation for the person. 

Step 376 represents retrieving a select paging group style sheet that 
corresponds to the subscriber interface of the communication space station 24 and 
step 378 represents providing both the address book content and the select paging 

25 group style sheet to the communication space station 24. Step 380 represents 
updating the communication space station state table 243 to indicated that the 
communication space station 24 is in the select paging group state. 

Figure 10c represents an exemplary display of the select paging group 
content utilizing a style sheet that may be applicable for use on a display 72 

30 wherein the subscriber may use buttons or touch panel activation may be utilized to 
select one or more paging groups to include in the multicast page. It should be 
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appreciated that some paging groups may include only a single name such that 
Individuals may be selected to include in the multicast page. Because the list of 
groups included in the paging group content may be larger than can be displayed 
on the display 72, the style sheet may provide for only a portion of the content to be 
5 displayed along with touch activated scroll controls for display of the remainder of 
the content. The style sheet may further include touch activated controls to retum 
to the main menu and to start the multicast message. 

Figure 10d represents an exemplary display of the select paging group 
content utilizing a style sheet that may be applicable for display of the content on a 

10 display of a subscriber device 50 coupled in the modular docking interface 58. 
Because subscriber selection is to be by activation of buttons 92, the style sheet 
provides for the content to be displayed with the groups on the left side for selection 
by buttons 92 on the left side of the modular docking Interface 58 and for indicators 
to label the function of the buttons 92 on the right side of the modular docking 

15 interface 58 such as scroll up, scroll down, start message, and return to main 
menu. 

The flowchart of Figure 9g represents steps performed by the web server 
application 230 upon receiving a subscriber indication of a command to start the 
multicast paging message. Step 384 represents receipt of such a subscriber 

20 indication along with Identification of the subscriber selected multicast groups to 
include in a multicast recipient list. Steps 388 through 394 represents steps that 
are performed by the web server application 230 for each recipient. Such steps 
may be performed in sequence or in parallel. For purposes of illustration, the steps 
are shown perfomned in sequence. Step 388 represents identifying the subscriber 

25 device 50 that Is associated with the recipient and determining if the subscriber 
device is then presently coupled to a communication space station 24. If yes, at 
step 390 the web server application 230 transmits a message to the 
communication space station 24 to indicate activation of the multicast session 
group. However, if the subscriber device 50 associated with the recipient is not 

30 coupled to a communication space station 24 where the subscriber may receive the 
multicast, then at step 404 the recipient is added to an e-mail list. 
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Following step 390, step 392 represents determining whether the 
communication space station 24 joined the multicast session group. If the 
communication space station 24 is operating a voice session, it would be 
inappropriate to interrupt the voice session with a multicast page for the subscriber. 
5 As such, it is envisioned that the communication space station 24 may, when in 
certain operational states, not join the multicast session group. In which case, the 
recipient is added to the e-mail list at step 406. At that time, the voice mail 236 is 
also invited to the multicast session group as an agent for all recipients on the e- 
3 mail list. 

"I 10 After the recipient is either added to the e-mail list at step 405 or the 

communication space station 24 joined the multicast session group at step 392, 
step 394 represents determining if steps 388 though 392 must be performed for 
additional recipients. If not, step 396 represents establishing a RTP channel with 
rii the communication space station 24 that initiated the multicast paging message 
15 and step 398 represent instructing the web server to prompt the subscriber to begin 
3 the multicast paging message. 

Step 400 represents multicasting the message to the session group utilizing 
the multicast module 231 and step 402 instructing the voice mail module to 
tenninate the multicast message, build an audio file, and send the audio file by e- 
20 mail to each recipient that was added to the e-mail list at either step 404 or 406. 

The flowchart of Figure 9h represents steps performed by the web server 
application 230 upon receiving a subscriber indication of a command to initiate a 
voice or a voice/video conference call from a communication space station 24. The 
communication space station 24 may detect such a subscriber indication by various 
25 means, such as by subscriber activation of the conference call control 502 on the 
touch panel 72 of Figure 10b or by activation of a button 92 corresponding to the 
conference call menu selection on the display screen 50 of Figure 10a. Step 404 
represents the web server application 230 receiving such an indication from a 
communication space station 24. 
30 Step 406 represents retrieving the subscriber's address book content 249 

from the e-mail files 247 and step 408 represents retrieving a "select conference 



Doc. 4729 



-31 - 



13944.111 Tel-011 

session participants" tliat corresponds to the subscriber interface of the 
communication space station 24 from the style sheets 241 in the memory 235. 
Step 410 represents providing both the address book content and the style sheet to 
the communication space station 24 for display. 

5 Step 412 represents receiving subscriber selection of participants for the 

conference call. Figure lOe represents an exemplary display of the address book 
for selection of conference call participants on the touch panel 72. The 
communication space station 24 may detect subscriber activation of the touch 
panel 72 to "highlight" conference call participants and indicate that selection is 

10 complete by activating a finished control 512. Upon activation of the finish control, 
the communication space station 24 provides the subscriber selection of 
participants to the web server application 230. Step 414 represents providing the 
conference session participant list to the packet vocie/video gateway 232 and step 
416 represents updating the state of the communication space station 24 to a 

15 conference call state. 

After receiving the session participant list from the web server application 
230, the packet voice/video gateway 232, or more specifically the call signaling 
module 227 (Figure 2) establishes applicable voice and video communication 
channels with those communication space stations 24 that are serving subscriber 

20 devices associated with the participants in accordance with the steps discussed 
with respect to Figure lis. With the communication channels open, the packet 
voice gateway 232 activates the conference mix module 237 to begin mixing the 
audio streams from each communication space station 24 participating in the call. 
The packet voice gateway also reports the status of each participant to the web 

25 server application 230. More specifically, the status includes an indication of 
whether each session participant is connected to the conference or is inactive (not 
connected to the conference). As discussed later, the status may also indicate 
whether the participant has stopped providing an active audio stream (e.g. put their 
phone on mute) and may Indicate whether the conference mix module 237 has 

30 suspended sending a conference mix to the participant (e.g. the packet voice/video 
gateway 232 has placed a particular participant on hold for a time period to so that 
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others can converse without such participant hearing the conversation). 

The flowchart of Figure 9i represents steps perfonned by the web server 
application 230 upon receiving conference status content from the packet 
vocie/video gateway 232. Step 418 represents receipt of the status content. Step 
5 419 represents retrieving a "status" style sheet form the style sheets 241 in the 
memory 235 and step 410 represents providing the status content and the style 
sheet to at least the initiating communication space station 24 and optionally, to 
other communication space stations 24 participating in the conference call. It 
should be appreciated that the steps for the flowchart of Figure 91 may be repeated 
10 several times during the duration of a conference call as the status of each 
'3 participant changes. 

^ Figure lOf represents an exemplary display of the status of each participant 

^ on the touch panel 72. The display includes a vertical listing of each participant 
and an Indication of the participants' status in a column 514. An "A" indicates that 
^1 15 the participant is active (e.g. sending a non-mute audio stream and receiving a 
conference mix audio stream). An "I" indicates that the participant is not on the 
£1 conference call. A "M" indicates that the participant has muted his or here 
^ telephone and is not sending an audio stream. An "H" indicates that the participant 
has been placed on hold by the Initiating communication space station 24 and is 
20 not receiving a conference mix. 

The display also includes a video indication column 516. This column 
indicates which participants are not sending a video image signal to the packet 
voice/video gateway 232 (e.g. the "O" symbol). Because the subscriber may select 
which of the participants to view during a video conference, the video column 516 
25 also Indicates the subscriber's selection of the video image to view if the subscriber 
activates the video control 520. In the exemplary display, the "*" symbol associated 
with Dave indicates that the subscriber would view the video image provided by 
Dave's communication space station 24 upon activating the video control 520. The 
subscriber may change such selection by utilizing the controls of the touch panel 
30 72. Upon detecting activation of the video control, the communicating space 
station 24 reports the indication to the web server application 230. 
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The display also includes a hold control 522. The initiating subscriber may 
indicate their desire to place a participant(s) on hold status by highlighting the 
participant(s) and activating the hold control 522. Upon detecting activation of the 
hold control 522, the communication space station 24 reports the indication to the 

5 web server application 230. Upon receiving the indication, the web server 
application 230 provides the indication to the packet voice/video gateway 232 
which places the selected participant(s) on hold status and return updated status 
content to the web server application 230. 

The flow chart of Figure 9j represents steps performed by the web server 

10 application 230 upon receiving a subscriber indication of a video image selection 
from a communication space station 24. Step 426 represents such receipt by the 
web server application 230. Step 428 represents providing the video image 
selection to the packet voice/video gateway 232. The packet voice/video gateway 
232 then begins relaying the selected video image to the subscriber station. Step 

15 430 represents the web server application 230 retrieving a style sheet for the 
display of the video image. Step 432 represents providing the style sheet to the 
communication space station 24 and step 434 represents providing instructions to 
display the video image received from the packet voice/video gateway 232 in 
conjunction with the style sheet. 

20 Figure 10g represents an exemplary display of a single video image on the 

touch panel 72. The display includes a control to return to the status page which, 
when activated, causes the communication space station 24 to return to the display 
of Figure 10f. The display also includes a scroll video control 530 which, when 
activated, causes the communication space station 24 to report such activation to 

25 the web server application 230. The web server application 230 performs the steps 
discussed with respect to Figure 9 with the selected image scrolled by one video 
image. 

The display also includes a % video control 528 which, when activated, 
causes the communication space station 24 to report such activation to the web 
30 server application 230. The web server application 230 performs the steps 
discussed with respect to Figure 9 but the packet voice/video gateway 232 provides 
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a mixed video image comprising each of four video images arranged in the four 
corners of the display as represented by Figure 10h. From any of the displays 
associated with the conference call (e.g. Figure 10e, Figure 10f, Figure lOg, and 
Figure 10h, termination of the call causes the communication space station 24 to 
5 return to the main menu as represented by Figures 10a or 10b. 

It should be appreciated that the systems and methods of the present 
invention provides enhanced conference call services to subscribers to the 
multimedia communication management system of the present invention. Although 
the invention has been shown and described with respect to certain preferred 
10 embodiments, it is obvious that equivalents and modifications will occur to others 
i;i skilled in the art upon the reading and understanding of the specification. It is 
'u^ envisioned that after reading and understanding the present invention those skilled 
ifl in the art may envision other processing states, events, and processing steps to 
W further the objectives of the modular multi-media communication management 
!^ 15 system of the present invention. The present invention Includes all such 
W equivalents and modifications, and is limited only by the scope of the following 

i'il 

U claims. 
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